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Abstract. In this paper we study the measure-theoretical entropy of the 
one-dimensional linear cellular automata (CA hereafter) T^[_j^], generated 

r 

by local rule f{x_i, . . . ,Xr) = \xi{mod m), where I and r are positive 

integers, acting on the space of all doubly infinite sequences with values in a 
finite ring Zm, Jri > 2, with respect to a Markov measure. We prove that if the 
local rule / is bipermutative, then the measure-theoretical entropy of linear 
CA rj[_;^] with respect to a Markov measure fi^^p is 

m — 1 

h^i^p{Tf[_i^^]) = -{I + r) Yl PiPij^ogpij. 

i,i=0 



1. Introduction 

Cellular automata (CA for short), begun by Ulam and von Neumann, has been 
systematically studied by Hedlund from purely mathematical point of view 9j. 
Hedlund's paper started investigation of current problems in symbolic dynamics. 
The study of such dynamics called CA from the point of view of the ergodic the- 
ory has received remarkable attention in the last few years (pp, [Hj, CODj because 
CA have been widely investigated in a number of disciplines (e.g., mathematics, 
physics, computer sciences, etc.). In 11 , Shereshevsky has defined nth iteration 
of a permutative CA and shown that if the local rule / is right (left) permutative, 
then its nth iteration also is right (left) permutative. 

In ^U], Mass and Martinez have studied the dynamics of Markov measures by a 
particular linear cellular automata (LCA). They have reviewed some results on the 
evolution of probability measures under CA acting on a fuUshift. In [S], the author 
has studied the ergodic properties of CA with respect to Markov measures. 

Although the LCA theory and the entropy of this LCA have grown up somewhat 
independently, there are strong connections between entropy theory and CA theory. 
We give an introduction to LCA theory and then discuss the entropy of this LCA. 
For a definition and some properties of one-dimensional LCA we refer to |S| EI ■ 
The study of the endomorphisms and the automorphisms (i.e. continuous shift 
commuting maps, invertible or non-invertible) of the full shift and its subshifts was 
initialed by Hedlund in jUj. 
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It is well known that there are several notions of entropy (i.e. measure entropy, 
topological entropy, directional entropy etc.) of measure-preserving transformation 
on probability space in ergodic theory. It is important to know how these notions 
are related with each other. The last decade (see. e.g [3], 201); a lot papers are 
devoted to this subject. 

In TJ, the author has compute the measure-theoretical entropy with respect to 
uniform Bernoulli measure for the case Ai = 1, for all i G l^m- The author proved 
that the uniform Bernoulli measure is the maximal measure for these LCA. He has 
also posed the question whether the maximal measure is unique. 

In 2 , the author has investigated the measure-theoretical directional entropy of 
Z^-actions generated by LCA and the shift map with respect to uniform Bernoulli 
measure. Let m,k E N and A-^, . . . , Afe £ Z. Let (p: be a LCA with 

= {0, . . . , m — 1} and local rule 0(x)i = X]j"=-fe ^j^i+j (mod m). Assume (p is 
surjective and consider v — (ui, ^2) G Z^ with V2 > vi. In |2], the author has shown 
that the directional entropy of (p with respect to the uniform Bernoulli measure is 
given by the formula hy{4>) = 2^2 log to. 

In this paper we compute the measure-theoretical entropy of the one-dimensional 
LCA Tf[_i j.], generated by a bipermutative local rule 

r 

f{x-i, . . . ,Xr) — X] \xi(inod to), acting on the space of all doubly infinite se- 

i=-i 

quences with values in a finite ring Zm, to > 2, Ai S Z™, with respect to a Markov 
measure (J-tyP- We show that if the local rule is bipermutative, then we have /IttP 

m — 1 

is hf^^p{Tf[_i j,^) = —{I + r) piPijlog Pij. Also, we prove that if the Markov 

measure fij^p is uniform, then we get ^/i„p (?/[-!, r]) = (^ + '")log to. 

The organization of the paper is as follows: In section 2 we give the basic formu- 
lation of problem to state our main result. In section 3 we state our main theorem 
and prove it. In section 4 we conclude by pointing some further problems. 



2. Preliminaries 

Let Z„i = {0, 1, . . . , TO — 1} (to > 2) be a ring of the integers modulo to and Z^ 
be the space of all doubly-infinite sequences x — ixn)'?^=-oo ^ ^^'^ & ^m- 
A CA can be defined as a homomorphism Z^ of with product topology. The shift 
a : Z^ — > defined by {ax)i = Xi^i is a homeomorphism of compact metric 
space Z^. 

A CA is a continuous map, which commutes with cr, T : — > Z^ defined by 
{Tx)i — f{xi+i, . . . ,Xi+r), where / : ZJ^'+^ Z„i is a given local rule or map. 
Favati et al. |Sj have defined a local rule /, they have stated that a local rule / is 
linear (additive) if and only if it can be written as 

r 

(2.1) f{xi, ...,Xr)^ y^A,Xj(mod to), 

i=i 

where at least one between A/ and A^ is nonzero. We consider 1-dimensional linear 
cellular automata (LCA) ^/[/.r] determined by the local rule /: 

r 

(2.2) (Tx) = {yn)n=^oo,yn = f {Xn+l , ■ ■ ■ , Xn+r) = ^KXn+i{mod to), 

i=l 
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where A;, . . . , Ar £ Z„i. 

We are going to use the notation Tj[;^ for LCA-map defined in (|2.2|) to em- 
phasize the focal rufo / and the numbers I and r. If the focal rule / is given as Eq. 
(2.1), then the finite formal power series {fps for brevity) F associated with / is 

defined as F{X) = J2>'^X^\ where A;, . . . , A,. G Z„ (see 0, [El for details). The 

i=i 

technique of fps is well known for the study of these problems. In 3 , the author 
has studied the topological entropy of nth iteration of a linear CA by using the fps. 

The notion of permutative CA was first introduced by Hedlund in P|. If the 
linear local rule / : ZJ^'"*"^ is given in (2.1), then it is permutative in the 

jth variable if and only if gcd{Xj,m) = 1, where gcd denotes the greatest com- 
mon divisor. A local rule / is said to be right (respectively, left) permutative, if 
gcd{Xr,m) = 1 (respectively, gcd{Xi,m) = 1). It is said that / is bipermutative if 
it is both left and right permutative. 



3. The measure entropy of the one-dimensional LCA 

In this section we study the measure entropy of the LCA defined in Eq. (|2.2() 
with respect to uniform Markov measure. 

Definition 3.1. Let {X, B, /i, T) be a measure-theoretical dynamical system and 

oo 

a be a partition of X. The partition a is called a generator if \/ T~''a = B. 

k=Q 

Definition 3.2. Let a be a partition of X. The quantity 

is called the entropy of the partition a. Let a be a partition with finite entropy. 
Then the quantity 

ji-i 

i=0 

is called the entropy of a with respect to T. One often writes h{a, T) instead of 
h^{a,T). The quantity 

hf^{T) — sup{hf^{a, T) : a is a partition with _ff^(a) < oo} 

a 

is called the measure-theoretical entropy of {X, B, ij.,T), the entropy of T (with 
respect to ^). 

Theorem 3.3. ([T5|, Kolmogorov-Sinai Theorem) Let {X, B, /i, T) be a measure- 
theoretical dynamical system and a a generator with Hf^{a) < oo. Then h^^iT) = 
h^{a,T). 

In order to apply entropy theory to the one-dimensional LCA over ring 
(m > 2) we must define a-algebra B and the Makov measure fj. : B ^ [0,1]. In 
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symbolic dynamical system, it is well known that this cr-algebra B is generated by 
thin cylinder sets 

C =a [jajl, ■ ■ ■,js]s+a ^ {X e : Xa ^ jo , • ■ -^Xa+s = js}, 

where jo, Ji, ■■■,3s e 

Recall that a subshift of finite type a : X ^ X defined on a space 
(3.1) X^{xeZl: M(,„^,„^,) = 1, n e Z} 

for some m x m matrix M with entries either zero or unity. Let P — (p(i.j)) denote 
a m X m stochastic matrix {p[ij) > 0, X]JL^^P(i.j) ~ 1) with entries = iff 

^(i-j) ~ ~ {""0' '"'1, ■ ■ ■ ' ■"'m-i} be its left eigenvector. It is well known that 

ttP = tt. a pair tt, P defines a set function /i^p on the cylinders of Z^. Recall 
that the associated Markov measure is defined as follows: 

/^7rp(o[io, ■ • ■,ik]k) = T^ioP(ioM] ■ ■ ■P{ik-l,ik)^ 

See [7], ^U] and for the properties of the Markov measure. 

Let ^ be the zero-time partition of Z^^: ^ = {oH : < i < m}, where o[i] = {x £ 
Z^j : a;o = i} is a cylinder set for all z, < i < m. So, we can state the partition ^ 
as follows: 



(3.2) e = {o[0],o[l],...,o[™-l]}. 

Denote by A{^) sub-cr-algebra of B generated by the zero-time partition ^ of Z^. 

Let us consider a particular case. Assume that the local rule / is bipermutative, 
so, we have the following Lemma. 

r 

Lemma 3.4. (pp. Lemma) Suppose that f{x-i, . . . ,Xr) = \xi{mod m) is 

i=-i 

a bipermutative local rule, and ^ is a partition of Z^^ given in Eq. (3.2), then the 
partition ^ is a generator for one-dimensional LCA generated by /. 

In order to calculate the measure-theoretical entropy of the one-dimensional LCA 
Tf[_j.^r] with respect to uniform Markov measure we must prove whether Tj[_r,r] is 
a measure-preserving transformation. 

Proposition 3.5. Let T^[_;^] be an one-dimensional LCA over Z,„, and /[— r] 
be bipermutative local rule. Then Tj[_; is the uniform Markov measure-preserving 
transformation. 

Proof. Consider a cylinder set 

C =a [jo, jl, • • ■ , js]s+a = {xe Zf^ : xl^^ = jo, ■ • • , 4+^ = js}- 

Then the first preimage of C under is the follows: 

Tf^li^r] (C) = T^/h^.] ({^ e ^™ = JO, . . . , 4t = Js}) 

= [J ((a-r) [*0, *1, ■ ■ • , «2r+s]a+s+r), 

(»o,«i,...,»2,.+,)ez;<^''+"+'> 
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where Xa — '^fc^i+fe (mod to) and x^^^^ — -^fc^l+a+fc m). It is clear 

k=-l k=-l 

that, 

(a-/)[io,«l, ■ • -^il+r+sU+s+r) = {x G : xj^^^j = «0, ■ • ■ , x''^ls+r = n+r+s}- 

Then we have 

M7rp(a[jo,il, • ■ ■,js]s+a) = ""jo-POoJl) ' ' ■P(js-l,j.)- 

f^MC) = M.p({a;eZ^:x(")=jo,...,4+.=J.}) 

= fJ-Kp{ [J ((a-;)[io, il, ■ ■ ■ ,i{r~l)+s]a+s+r)) 



"1 ''M7rp((a-;)[*0' ■ • ■ , *(r+0+s]a+s+r) 
TO-^'^+l). 



□ 



Theorem 3.6. Let [i^^p be a Markov measure given by the stochastic matrix 
P = (pij) and the probabihty vector tt = (pi). Assume that I and r are positive 
integers and gcd{Xi,m) — 1, gcd{Xr,m) — 1. Then we have 

m—1 

i,j=0 

Proof. Now we can calculate the measure entropy of the one-dimensional LCA by 
means of the Kolmogorov-Sinai Theorem f|12). p. 95), namely, /i^^j, (r^[_r.r]) — 
hfj,^p{Tf[_rr]^0- Let ^ be the zero-time partition of Z^: ^ {o[i] : < i < m}, 
where o[i] = {x G Z^ : xq = i} is a. cylinder set for alH, < i < m. So, we can 
state the partition ^ as follows: 

e = {o[0],o [l],...,o [to-1]}. 

Denote by A{£,) sub-cr- algebra of B generated by the zero-time partition ^ of Z^. 
From the definition of entropy we have 

H^L„piO = -^7i/^7rp(oW)logAi(oW) = log TO. 
From Theorem 3.3 one has 

1 " 

n— >cxD n ^ — ^ 

log Pj_„,Pi_„r*-„,+i ■ ■ --Pi^.-ii^.- 
It is easy to prove by induction that the sum on the right hand side is equal to 



m—1 7n—l 



{{n{l + r) + l) ^ P^P^jl0g P^j) + ^ P^log Pi- 
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This implies the result. □ 

A Markov measure on is uniform, if measure of any one-dimensional cylin- 
der is equal to ^ , where m is a cardinality of Zm- A doubly stochastic matrix is 
a matrix P such that P and P*^ (transpose) are both stochastic. If a matrix P 
is a doubly stochastic then corresponding Markov measure is a uniform measure. 
Cardinality of is equal to m, so that any doubly stochastic matrix P of m x m 
size will generate uniform Markov measure. 

Corollary 3.7. Let fi-^p be the uniform Markov measure on Zf^ and 

r 

f{x-r, . . . , Xr) — "Yli AiXi(mod m), where /[— r] is bipermutative. Then measure- 

i— — r 

theoretic entropy of the one-dimensional LCA T^[_r,r] with respect to /x^p is equal 
to 2rlog m. 

Proof. It is clear that the partition ^ V Tyjl^ {£,) is as the following; 
Because of the uniform Markov measure we get 

= -TO(2r+l)^-(2r+l)iQg m-^^^'+l) = (2r + l)log TO. 

If we continue, from Lemma 3.4 we have the following results: 

n 

-^/^ttP ( ^/ ^j^^—r r]^) ^/^ttP ( — nr — nri ■ ■ ■ i ^nr]nr) ^ 

fe=0 

logfl'j^p i^ — nr — nr ; ■ • • ; ^nr] nr ) 
= -m(2«'-+l)TO-(2„r+l)^^^^-(2nr+l) 

— (2nr + l)log m. 
From Theorem 3.3 and Lemma 3.4 we have 

1 " 

h^^ATfl-r, r]) = Jim^-i?^,,( V^^/A r]0 = 2rlog TO. 

□ 

4. Conclusion 

This paper contains the following results: We have found a generating partition 
for the one-dimensional LCA generated by a bipermutative local rule (Lemma 3.4). 
We have calculated the measure-theoretical entropy of the one-dimensional LCA 
with respect to any Markov measure (Theorem 3.6). This is the first step toward ar- 
bitrary Markov measure classification of multi-dimensional CA defined on alphabets 
of composite cardinality. In the author has compute the measure-theoretical en- 
tropy with respect to uniform Bernoulli measure for the case Xt = 1, for all i G Zm- 
The author proved that the uniform Bernoulli measure is the maximal measure for 
these LCA. He also posed the question whether the maximal measure is unique. 
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Thus, where a question raises: 
Using the Theorem (52, Theorem 7.13. (ii)), can one calculate the topological 
entropy of the LCA Tj^[_^ ,,] : X ^ X, where X is defined as in Eq. (3.1)? Also 
it is open question whether the uniform Markov measure is maximal measure for 

'^fl-r,r] ■ X X. 
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